IN THE CLAIMS 

1. (Currently Amended) An information processing method comprising: 

a viewpoint position/sight line direction determination step of determining 
a viewpoint position and a sight line direction on a map; 

an annotation display position determination step of determining an 
annotation display position of an object, from the position of said object on the map determined 
based on observation directions of said object in plural panoramic images, the viewpoint 
position, and the sight line direction; and 

a synthesis step of synthesizing an annotation image to the annotation 
display position on an actually taken image corresponding to the viewpoint position 

a reading step of reading a panoramic image according to the viewpoint 
position from a storage unit which stores plural panoramic images, and cutting out a display 
image from the read panoramic image based on the sight line direction, wherein the storage unit 
stores the plural panoramic images respectively while associating them with routes set on the 
map; 

a relative coordinate calculating step of calculating relative coordinates of 
an annotation object with respect to the route to which the view position corresponds; 

a display position calculating step of calculating a display position of said 
annotation object based on the viewpoint position and the relative coordinates of said annotation 
object; and 

a combining step of combining said annotation object with the display 
image based on the calculated display position . 
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2. (Original) An information processing method according to Claim 1, 
wherein the map is a two-dimensional map image. 

3. (Currently Amended) An information processing method according to 
Claim 1, wherein said annotation display position determination step determines the annotation 
display position of the panoramic image located between said plural panoramic images, by using 
the determined position of the object on the map each said route is defined by segment points at 
both ends thereof, and 

said relative coordinate calculating step sets one segment point of the route to 
which the view position corresponds as an origin, and sets said route as an x axis . 

4. (Currently Amended) An information processing method according to 

relative coordinate calculating step acquires observation directions of said annotation object at 
the respective segment points, and calculates the relative coordinates of said annotation object 
from the observation directions at the respective segment points, and 

said information processing method further comprises a setting step of manually 
setting the observation directions at the segment points by using a GUI (graphical user interface) . 

5. (Canceled) 
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6. (Currently Amended) A control program , stored on a computer-readable 
storage medium, for causing a computer to execute [[a]] an information processing method 
comprising: 

a viewpoint position/sight line direction determination step of determining 
a viewpoint position and a sight line direction on a map; 

an annotation display position determination step of determining an 
annotation display position of an object, from the position of said object on the map determined 
based on observation directions of said object in plural panoramic images, the viewpoint 
position, and the sight line direction; and 

a synthesis step of synthesizing an annotation image to the annotation 
display position on an actually taken image corresponding to the viewpoint position 

a reading step of reading a panoramic image according to the viewpoint 
position from a storage unit which stores plural panoramic images, and cutting out a display 
image from the read panoramic image based on the sight line direction, wherein the storage unit 
stores the plural panoramic images respectively while associating them with routes set on the 
map; 

a relative coordinate calculating step of calculating relative coordinates of 
an annotation object with respect to the route to which the view position corresponds; 

a display position calculating step of calculating a display position of said 
annotation object based on the viewpoint position and the relative coordinates of said annotation 
object; and 

a combining step of combining said annotation object with the display 
image based on the calculated display position . 
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7. (Currently Amended) An information processing method, used in an 
image reproduction apparatus for achieving walk-through in a virtual space represented by using 
an actually taken image, of synthesizing an annotation image to the actually taken image, said 
method comprising the steps of: 

reading the actually taken image from a storage unit which stores plural 
actually taken images respectively being made correspondent to a map, and displaying the read 
actually taken image; 

setting an annotation display position in each of the plural the displayed 
actually taken image[[s]] based on a manual instruction ; and 

calculating an annotation display position [[to]] of another actually taken 
image located between the plural actually taken images to which the annotation display positions 
have been set respectively , [[by using]] based on the annotation display positions respectively set 
in the plural actually taken images[[; and]] 

synthesizing the annotation image to the actually taken image on the basis of the 
calculated annotation display position . 

8. (Canceled) 

9. (Currently Amended) An information processing method according to 
Claim 7, wherein the annotation display position to said another actually taken image is 
calculated by performing interpolation to the annotation display position set in each of the plural 
actually taken images said calculating step acquires the annotation display position of another 
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actually taken image, by interpolating the annotation display positions respectively set in the 
plural actually taken images . 

10. (Currently Amended) An information processing method according to 
Claim 9, wherein the interpolation is non-linear interpolation^, and]] 

from among plural non-linear curves previously held, the non-linear curve 
is determined based on the annotation position of the object in each of the plural actually taken 
images. 

11. (Currently Amended) A control program , stored on a computer-readable 
storage medium, for causing a computer to execute [[a]] an information processing method, used 
in an image reproduction apparatus for achieving walk-through in a virtual space represented by 
using an actually taken image, of synthesizing an annotation image to the actually taken image, 
said method comprising the steps of: 

reading the actually taken image from a storage unit which stores plural 
actually taken images respectively being made correspondent to a map, and displaying the read 
actually taken image; 

setting an annotation display position in each of the plural the displayed 
actually taken image[[s]] based on a manual instruction ; and 

calculating an annotation display position [[to]] of another actually taken 
image located between the plural actually taken images to which the annotation display positions 
have been set respectively , [[by using]] based on the annotation display positions respectively set 
in the plural actually taken images[[; and]] 
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synthesizing the annotation image to the actually taken image on the basis 
of the calculated annotation display position . 

12. (Currently Amended) An image reproduction apparatus comprising: 
a viewpoint position/sight line direction determination unit, adapted to 

determine a viewpoint position and a sight line direction on a map; 

an annotation display position determination unit, adapted to determine an 

annotation display position of an object from the position of said object on the map determined 

based on observation directions of said object in plural panoramic images, the viewpoint 

position, and the sight line direction; and 

an image reproduction control unit, adapted to synthesize an annotation 

image to the annotation display position on an actually taken image corresponding to the 

viewpoint position 

a reading unit, adapted to read a panoramic image according to the 
viewpoint position from a storage unit which stores plural panoramic images, and adapted to cut 
out a display image from the read panoramic image based on the sight line direction, wherein the 
storage unit stores the plural panoramic images respectively while associating them with routes 
set on the map; 

a relative coordinate calculating unit, adapted to calculate relative 
coordinates of an annotation object with respect to the route to which the view position 
corresponds; 
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a display position calculating unit, adapted to calculate a display position 
of said annotation object based on the viewpoint position and the relative coordinates of said 
annotation object; and 

a combining unit, adapted to combine said annotation object with the 
display image based on the calculated display position , 

13. (New) An information processing apparatus, used in an image 
reproduction apparatus for achieving walk-through in a virtual space represented by using an 
actually taken image, for synthesizing an annotation image to the actually taken image, said 
information processing apparatus comprising: 

a reading unit, adapted to read the actually taken image from a storage unit 
which stores plural actually taken images respectively being made correspondent to a map, and 
adapted to display the read actually taken image; 

a setting unit, adapted to set an annotation display position in the displayed 
actually taken image based on a manual instruction; 

a calculating unit, adapted to calculate an annotation display position of 
another actually taken image located between the plural actually taken images to which the 
annotation display positions have been set respectively, based on the annotation display positions 
respectively set in the plural actually taken images. 
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